🏠 Self-hosted AI

Model Optimization, Inference Engines, LLM Quantization, Privacy-focused Deployments

Reinforcement Learning Unleashed: Tiny Agents, Mighty Insights
dev.to·22h·
Discuss: DEV
📱Edge AI
InferenceMAX – open-source Inference Frequent Benchmarking
github.com·2h·
Discuss: Hacker News
🏗️AI Infrastructure
SPAD: Specialized Prefill and Decode Hardware for Disaggregated LLM Inference
arxiv.org·18h·
Discuss: r/LLM
💻Local LLMs
AI Guardrails, Gateways, Governance Nightmares
go.mcptotal.io·14h·
Discuss: Hacker News
🤖AI agents
6 free tools that should be on every self-hoster's machine
xda-developers.com·13h
🏢Self-hosting
LoRA Explained: Faster, More Efficient Fine-Tuning with Docker
docker.com·1d
🏗️AI Infrastructure
2025-10-10 # LLMs Are Transpilers
alloc.dev·22h·
Discuss: Hacker News
💻Local LLMs
Hardware Vulnerability Allows Attackers to Hack AI Training Data – NC State News
news.ncsu.edu·1h·
Discuss: Hacker News
⚡Hardware Acceleration
Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning
arxiviq.substack.com·1d·
Discuss: Substack
🏗️AI Infrastructure
10 Data + AI Observations for Fall 2025
towardsdatascience.com·8h
🏗️AI Infrastructure
Neuro-Symbolic AI
en.wikipedia.org·7h·
Discuss: Hacker News
🧠Neuromorphic Chips
AI Renaissance: Bridging the Gap Between Intuition and Logic
dev.to·12h·
Discuss: DEV
📱Edge AI
Reflection raises $2B to be America’s open frontier AI lab, challenging DeepSeek
techcrunch.com·23h·
Discuss: Hacker News
🏗️AI Infrastructure
The Trillion Dollar AI Software Development Stack
a16z.com·54m·
Discuss: Hacker News
🧩Low-code
Self-Improving LLM Agents at Test-Time
arxiv.org·18h
🤖AI agents
The Hidden Oracle Inside Your AI: Unveiling Data Density with Latent Space Magic by Arvind Sundararajan
dev.to·1d·
Discuss: DEV
📱Edge AI
A Manifesto for the Programming Desperado
github.com·6h·
Discuss: Hacker News
🧩Low-code
VLLM Predicted Outputs
cascadetech.ai·1h·
Discuss: Hacker News
💻Local LLMs
AI News and Releases: First Week of October 2025
dev.to·6h·
Discuss: DEV
🏗️AI Infrastructure
Evaluating Gemini 2.5 Deep Think's math capabilities
epoch.ai·8h·
Discuss: Hacker News
🏗️AI Infrastructure